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ABSTRACT 

This Carnegie-Mellon University Libraries study 
compared the ef fecti^veness of two methods of current awareness 
service: computerized updates and the distribution of the tables of 
contents of journals. In particular it compared the timeliness aid 
availability of articles in-house with the greater coverage but 
longer time lag (and possible lower accessibility! of articles cited 
in computer updates. Fortyeight randomly selected faculty members 
from the chemistry and public affairs departments were segmented into 
three groups and given retrospective searches on the topics of taeir 
choice. Thereafter, one group received only computer updates, an:;ther 
tables of contents, and the third a combination of both« Participants 
then evaluated their service via questionnaires. It was found th=t 
the tables of contents generally provided a more valuable service 
than the cowputer updates. The report cites nine references and 
includes tables and sample questionnaires. (FH) 
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Carnr:- iv.'- lel"^^^ ■L"-..:veTsliy Lirz^ries have s-:- lied computer iz . I 

bibl -ogra: ::ic - _ces :ince Septerrjier 1975. Hove- r a current awareness 

ser ice hc„s n-- :. -^r. offered by th libraries. e University Libr :ie: 
received ciz::^.^ i'' m r-.-nire founliLii^on in r rr. e tc a proposal 
included i : . - .: goa^i n'. 5sri:??'t on of pr^ ^-_-n of access to 

i_:.formatni ".t-_::c 3 srrnall r..-T.ount . ese fur.=_: had the opportu: 

t: condi:::t ■ /-i:rr on rr.ethods ot sur-;^- i~ r.g currer.- ^ -fonr.ation on top: - n 
ci interest .r us-'^:.-^- T^e study te.^m consis-;^ .: the authors of -S 

paper and s^ver. .^IdIIc 2:er-7~ e libra'- larr.s from all :r:re-e university lilrr nries. 

The Tv.^szjis.:: ru-v; 1. raised as r :.:ie reason : .:r irur..l.ng yet another i^tudy 
of currer z a war^rr:- ■ - , ::crtlc\J.arly el,., ^zademic librari:££ have tradition _ly 
devoted less -.-rre to s lective diss—l'z.ation of inf orria^iion or SDI and 
cu rrent awaren,- i-.\\n. : ther types ~ libraries (see Rc ley (1979) and 
Line (19^:.-)). vant- d to tijiterrdn^e the valae of compunerized updates a 

relatively ne* - • - :c ' f : vv-rent aw:::: ^-ness , and to exaz-r.-ie a variation of an 
older manual r.--:..^;'^ , t'- ' i -^-rriburion of the rabies of ontents of journals. 
We saw the larter, mf ^.rn:- which focussed on periodici^-S received by he 
librarier., as a ^37 -- -"l.--; -e the value of those jourr.rils to the camp -;s 
community, durinc a tirre when periodical subscriptions -re being severely 
reduced. In selern- 1 tie retholH of current awareness for comparison in our 
study, we wanted one r?— cl :hat we might feasibly continue to supply at a 
nominal cost after tr.- 3Ci<n v;as over. The contents pages in contrast to t'le 
computer updates :iuet mi; criterion. 



CURRENT AWARENESS SERVICES PROVIDED DURING THE STUDY 

All participants received an initial computerized retrospective search 
on the topic of their choice- For the next six months some received computerized 
updates, some received the manual service and some received both services. 
The retrospective search brought participants up-to-date on the topic they had 
selected. The retrospective search also aided the librarians in developing the 
search profile for the updates, for those in groups which were to receive the 
computer updates. For these people monthly, bi-monthly or bi-weekly updates 
were provided over a 5-month period, using the databases available from Lockheed 
and SDC. Frequency was determined by availability, and/or number of databases 
being used for a particular profile. The limiting factor was that the cost for 
six months of updating was not to exceed $50.- or an average of $10. ~ per month 
per participant. 

Each participant who was to receive the manual service was asked to identify 
six journals he did not subscribe to personally or otherwise scan reg^^iarly, and 
so received a very specific group of contents pages. Titles chosen were flagged 
in the periodical check-in file, copies of contents pages were made or receipt 
and were forwarded tc the participants. 

PREVIOUS STUDIES 

In the design of the study we drew on previous work on current awareness 
reported in the literature (Warden, (1978) , Vincent and Seals, (1975) , Parker and 
Essary, (1975), "o - cnn (1977) and Brandli , (1976)). 

Provision o: . * aputer updates has been described previously (for example 
Warden). Monucil .-rent awareness methods described include scanning periodicals, 
reviewing periodical indexes and tables of contents of books etc. (See Vincent 
and Seals, and Parker and Essary) . 

In some cases these current awareness services require a significant amount 
of professional time (Cosmann) . Many articles have described contents page 
services. The one described by Campbell (1978) is selective to a degree, and 
each set of contents pages was routed to a small number of users. This compares 
favorably to other methods, where large numbers of contents pages in broad 



groupings are sent to entire academic departments. Typiciilly ^ per 
name begins with a letter late in the jalphabet will recez/^e the ccr 
weeks after they are sent out, and, because the grouping,: r-re s: :; . 
have to then v;ade through many to find the ones he really wants r. 
The present srudy differed froir. -r'-ers in that the parriru _ar tyt- 
page distriburdon had not been e ^^luated previously. 

Some of :me questions we asi ed of participants were ■ a same 
used in previous ^.-tudies. We are indebted to p'-revious sru les fc: 
questions ve a::ministered to the participants. ;See Warde:. .nd ,1. 



PURPOSES OF THE STUDY 

The principal purpose of the study was to compare the zwo nz • -jz ness 
services. In particular we sought to compare the timeliness anz nvai—Bh^^.^y 

of articles in^house with the greater coverage but longer time Ic mr. ^.oss .ole 
lower accessibility of articles cited in computer updates. We v:^ " 
determine whether one method was significantly more successful t'r z':^ ^t; :r 
in meeting user needs. 



The second major purpose of the study was to discover the r ^' 
by faculty to keep up-to-date in their fields. 

A third purpose was to determine if there were any signifi: 
in the methods used to keep current by the two participant grou:- 

As a by-product of th^^ study we hoped to make the campus ccnvu. 
aware of the capabilities of computerized bibliographic searchir 



ui-ec 



Brer-ices 



METHODOLOGY OF STUDY 



Two groups of faculty members were identified - one group 
the Chemistry and Chemical Engineering departments (Chem/Chem E 
of the School of Urban and P\ablic Affairs and the Graduate Schc: . 
Administration (SUPA/GSIA) . These two groups were chosen as th 
to identify -wo homogeneous groups, where for the first: group trr^ ... 
bases are well established and terms used in searches well defined 
second group the bases are less tailored to user requirements, tenr, 
areas of research are diverse and citations widespread in many types of 
publications. 
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tctal ^'ticipants wa? decided upon. Cost limi-ations prever.-.ed, 

or -silrc a - .:jmber. A randi samp'^e of 14, c jsen f">"Oin "he total acv.lty 

ir. n of 'L' - . areas, was selec-f:d, straxii-^d i.-.to senior and junior 

fa:^_ -' Tier expected some reople cr. oser 'e: unv;illir.r to participate 

ar. V :: . •' others, also selected ra, .ic As an .-rentive tc 

p _ z STudy, subjects ve :e given th-: services f: of charge 

i:: e::r~;j-.r r -.-oplying inforir.aticr for the st^-.r The ' ^rticipants were 

rar.dcr... ' ..i-.i -ri three group s ar.r:. each group r-:' :- ive:- > i-ospective 

•rcmpu'r .- e topic of rhei choice. G~: - ::eived only 

-oinpu'_e: :- 2roup B received : ;ly tables cf :-.:\t~v^ a: d Group C received 

:.oth ~ V?^ s -i2:-res- Librarians from the three ~zss^:'^^ . libraries were, 

vithi-r ': - i.ea^s, randomly assigned to work vrit.": :fhe arzi^clpants. 

_ V- _ -jllected at various s-ages of the six-T ... :h s rudy and were 
Tabulc:?.r c -J:- computer using MINITJiB. In order tc : — ^ntifv response bias a 
shor- .'K -r.i^ire was completed by all participants, and b' those v;ho declined 
to pi' -pa-^- -before the study began. We also wantc- ^ to determine reasons for 
non-i. : ' \^rir. 1- .n. All were asked about their previ --s experience of comput.^^r- 
aided jL:.^liog: hie searches and current awareness s rvices. Although over 
'::ne-^Vr-rc of ^ , faculty members contacted were unvilling to participate, 90% 
of t: e gave .3 their reason their absence from campus for the duration of the 
-Stud- T .os-r \-_D could not participate were quesr.-oned on their experience of 
comrv rized lULiographic searches, how they kep- abreast of the literature 
in 1 _r fiel:. and how often they visited the lib: ry to browse among the 
oericcL_cal3. r^iis group did not differ signif icanv-Ly in these characteristics 
fron -hose who were willing to participate. Thus : is felt that there was no 

3sp: nse bias in the sample- 
After receiving a complete retrospective searrn of their area of interest, 

articipants were asked for an evaluation of the s\^ch and how it could be 
orcved. -:hen he or she searched for an article r ed in the search the 
ii.^rticipant was asked to complete a short questionna- iie describing where the 
article was obtained, how long it took to retrieve i— and how useful it was. 

Throughout the next six months participants were expected to complete a 
for- for each citation from the current awareness services which they looked' 
up, again describing where they found it, how long in took and now useful it was. 
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CILARACTERISTICS OF PARTICIPANTS 

articipants for complete iata have been collected include 20 fror 

Zh : :ry and Chemica." rineering iChem/Chem E) , and 15 frcr the School of *rban 

and ..;blic Affairs ar a Graduate School of Industrial Administration (SU?A/GSIA) 

rhos who dropped out - aer the study began did so because they left the 

university, were not ^lilable for interviewing or just lost interest. 

At the start of ir:^ project all participants were questioned about their 
previous experience v^_.h bibliographic searching, the frequency of their use of 
ahe library, and their methods for keeping up-to-date with the research in their 
field. 75% of the hem/Chem E group and about 401 of the SUPA/GSIA group had • 
previously received a retrospective computerized bibliographic search either at 
Carnegie-Mellon University or elsewhere. But only 25% of the Chem/Chem E's and 
10% of the others had had experience of computerized current awareness services. 
The frequency with which the faculty members reported that they visited the 
library also differed. Over B0% of the Chem/Chem E's scanned the journals at 
least once a month (with 30% doing so once a week) , whereas only 50% of the 
SUPA/GSIA group browsed more than once a month. 

The entire SUPA/GSIA group relied hoavily on personal communication with 
other researchers in sim/lar fi;ilds, but only 80% of the Chem/Chem E group 
reported doing so. Similar proportions in both groups reported reading 
"Current Contents", (28%), using indexes and abstracts (61%), attending 
conferences (86%) , and maintaining personal subscriptions to journals (78%) . 
Other updating mechanisms reported included circulation of "Current Contents" 
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within a small interdisciplinary research grov" , fcrmal exchange of working 
papers, rhe use of commercial alerting service-, -he work cf a research assistant 
auid using references cited in papers of inter^t. (See Table 1) . 

It has been suggested that senior and jur..-oi- faculty iTiemhers have different 
current swareness needs and methods. For this : .ason the sample ves 
stratified into senior (associate professor ar^ ._bove) and jur.ic: faculty members. 
The reB;pcnse rate was the same for both classi ' ations. Althju^ slight 
differences were observed in current awarenesr : .jtr.ods (e.g. a slightly higher 
proportion of senior faculty members relied mzz heavily on conferences and 
personal communications and had a slightly Ic :ei frequency of browsing in the 
library) these differences were not statistically significant. Although we 
could discern little difference between senior z.nc junior faculty, we did observe 
differences between the two groups, Chem/Ch* E and GSIA/SUPA These differences 
and similarities are discussed below. 

During and after the study there was a: increased demand for computer 
searches from the departments of the participants and the participants them- 
selves. Of the 35% of the participants whc requested another search during the 
nine months immediately after the beginning of rhe project, a third had never 
requested a computer search before. 

THE RETROSPECTIVE SEARCH 

About 75% of both groups chose a topic in their ongoing reseai'ch interest, 
while others chose a new topic or a topic of general interest to them. A 
surprisingly large proportion of the GSIA group, 60%, said that they used the 
search to confirm what they already knew, thus they did not expect to find many 
new sources. Only 15% of the Chem/Chem E's used the retrospective search in this 
way. In general the Chem/Chem E's put the search to greater direct use, four 
used it to prepare research proposals, four used it to prepare bibliographies for 
papers, and three others gave :he bibliography resulting from the search to PhD 
students as background for a thesis. Nearly all the participants looked up and 
read some of the references they received. Four of the Chem/Chem E's and three 
of the SUPA/GSIA group found little or no use for the searches which were 
unsuccessful mainly because there were no appropriate databases. 
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Tr.f ■ er of citations found by the retrospective searches varied widely, 
the sma - being 15 and the largest being 841. About 26% of the Chem/Chem E 

group -T-.d over 500 citations while only one person in the SUPA/GSIA group 

receiver i:iany. Approximately one-third of each group received less than 

100 cir^ ;.„'.:-£ from their retrospective searches. (See Table 2) . 

T: 3 s--rch strateqies for the SUPA/GSIA group took longer to develop with 
an avei i^e Df over four hours compared to an average of one and a half hours for 
the Ch- em E group. Two factors may account for these differences: 
1) the -eed to use a number of databases for the first group, and 2) lack of 
experience on the part of some librarians. The implementation of the developed 



search 5;trategies took an average of one hour for both groups. 

In general more databases were used for the SUPA/GSIA searches with over 
half searches involving the use of three or four databases. About one-third 

of th^ searches in both groups involved the preliminary investigation and 
subsequent rejection of one or more databases. 

Costs of the retrospective searches for the two groups differed. The 
searches for the Chem/Chem E*s generally cost less chan those for the others. 
(See Tables 3A and 3B) . The median cost for the Chem/Chem E's was $47, and 
■For the SUPA/GSIA group the median was $58. About 18% of the searches for the 
latter group cost over $100 and these were by no means the most successful 
(cf. Evans (1980) - costs being incurred by having to use more than one database.) 
When informed of the cost of their search and asked whether they would pay for 
it had it not been free, 70% of the Cliem/Chem E*s would have paid out of their 
research grants as compared to only 50% of the SUPA/GSIA group* Out of 14 of the 
Chem/Chem E's who would have paid something out of their own pocket, nine would 
have paid more than the search actually cost (in some cases consid'.-rably more) . 
Wone of the SUPA/GSIA group would have paid the whole cost although about 65% 
would have paid something towards it (about $30 on average.) 

To gather information on the participants* assessment of the search, they 
were given a list of possible negative characteristics describing the search 
'and a list of positive characteristics and asked to indicate those which applied 
to their search. Among the chemists the most striking positive reaction was 
that 45% reported that they were made aware of other researchers in the same 
field and nearly 80% found relevant references of which they had not previously 

Er|c ' ^ 9 
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been aware. The only negative aspect reported by 5C% of respondents was that 
the references were not available in the CMU libraries. All other negative 
aspects such as the search was too broad, too narrow, important references 
were missed were reported by iinder 20% of respondents. Among the GSIA/SUPA 
group there was a higher percentage of negative, remarks and also a higher 
percentage of positive remarks. Almost 50% reported that they were made aware 
of other researchers in the same field, 95% found articles of which they had 
not previously been aware and just over 20% were provided with new research 
leads. Even those those intention was to confirm what they already knew found 
new references. However, 40% said that important references had not been 
picked up, and 40% paid that there were too many irrelevant references. 

Seven of the participants received searches from databases which included 
abstracts of the papers cited. Two of these participants mentioned that the 
abstracts were extremely useful in evaluating the citations and choosing which 
to read. Unfortunately there is not enough data to determine whether the 
presence or absence of abstracts made a substantial impact on the participants 
evaluation of the searches. 



The cost of supplying computer updates to the two groups; over the six 
month period did not differ greatly. The average cost for the Chem/Chem E*s 
being $30 over the entire six months and for the SUFA/GSIA group $37. (See 
Table 5) . The former group received far more updates per person. Ci-e bases 
in this area are updated more frequently and the average cost of each update 
was only $6. Most participants in the SUPA/GSIA group received only two or 
three updates over the six months as the bases were updated less frequently; 
the average cost of these updates was about $20. Most of the updates did 
not use a large number of search terms. Out of the 25 cases for which we 
recorded data on computer updates, 15 involved 5 search terms or less. Six 
used six to ten search terms, and the remaining four had eleven, twelve, sixteen 
and twenty-eight search terms. The Chem and Chem Engineering group revealed a 
wider divergence of nu:nber of search terms (1 to 28) than the other group. 

Only the direct costs of providing the service was calculated, no attempt 
was made to assess staff costs. Similarly costs for the tables of contents 
include the cost of reproduction only. Computed at 5C per page the average 
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direct cost per participant of supplying the tables of contents for six months 
was $1.50. Even if we were to include direct costs, the tables of contents 
current awareness servi^-e could be provided on an continuing basis at a minimal 
cost, since all copying and mailing could be ^one by work-Gtudy students. 
Set-up costs would also compare favorc±)ly with the cost of developing search 
profiles for computer updates. The costs would involve mailing questionnaires 
to faculty, receiving replies, flagging the periodical check-in file and 
generating mailing labels and lists. 

The answers to the question on optimal frequency for computer updates 
revealed a noticeable difference between the two user groups. Among the 
Chcm/Chsm E's, 40% vrant them at least once a month, 30% want them every two to 
six months and 30% did not know, toong the SUPA/GSIA group only 10% wanted them 
once a month, 10% every three months, 40% every six months or less frequently 
and 30% did not know. We surmise that this is indicative of the n,umber of 
references expected in an update. The Chem/Chem E's typically received ten 
citations a month or more and the others under five or sometimes none at all, 
although three of the SUPA/GSIA group received an average of over 20 a month. Also 
stated was the fact that many did not have the time they need to follow up on the 
literature immediately. 

As was the case with the retrospective search, a questionnaire was administered 
to elicit the participants' evaluation of the current awareness services. The 
The participants were asked whether they would like to continue receiving the 
current awareness services if, (1) they continued to be provided free of charge; or 
(b) if they had to pay for them. The results indicate that the tables of contents 
would be ver popular with about 70% of both the Chem/Chem E,and the SUPA/GSIA 
groups wanting them regardless of whether they had to pay. Among those receiving 
computer updates the responses were that over 90% of each group would wish to 
continue if they were free and about 70% of both groups would wish to continue if 
they had to pay. 

At the outset of the project we hypothesized that the greater timeliness of 
the contents pages would make them more attractive to the participants. (Articles 
appear in tables of contents at least three months before they appear in the data- 
bases from which computer updates are generated.) However only 30% of the partici- 
pants regarded this feature as important. With a few exceptions, the consensus was 
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that the timeliness was not important especially when taken with a possible two 
year delay between the writing of an article and its publication. The advantage 
of the contents pages seemed rather to be that the participant could easily scan 
a journal he did not normally browse and be aware of articles outside his normal 
field of interest. The participants whose research areas were interdisciplinary 
and who could not get a comprehensive computer search were especially enthusiastic 
about the contents pages. In at least two cases participants entered a s\abscrip- 
tion for a journal they hadn*t previously received, because the contents pages 
revealed mdny articles of interest. 

Interestingly, several participants suggested that they would like contents 
pages of journals from other libraries, particularly those in the immediate 
vicinity, indicating that avaiiabiliry = of journals in-house is perhaps not as 
vital, in some cases, as we had assumed. 

In the final evaluation of the two types of services, the entire SUPA/GSIA 
group rated the tables of contents provision as more valuable to them or at least 
as valuable as the computer updates. Only one of the Chem/Chem E group rated 
iie contents pages as more valuable and one rated them equally valuable. 

It was hoped that each participant would complete a very short questionnaire 
1 .:ch citation he actually wanted to look up and read during the course of the 
: ... However this proved to be an unrealistic demand and only about half of 

the participants did so consistently. The questionnaire was designed to determine, 
where the citation was found, and how long it took to obtain it. Half the Chem/Chem E 
group did return the forms on citations received froiTi the retrospective search, 
updates and tables of contents, while only a quarter of the GSIA/SUPA group returned 
^uch forms, A conservative assessment of the incomplete data indicates that the 
Chem/Chem E g^cup had no difficulty obtaining the references, which were mostly 
available in the C-MU libraries; on the average they were rated moderately useful. 
The other group, however, did not obtain over a third of those references they 
wanted to see; those that they did find were perceived as useful. 

Throughout the survey the librarians involved provided feedback as to the 
problems involved in the searches. In the interview at the conclusion of the study, 
the librarians stated that in only three cases out of the thirty-nine the databases 
available were entirely inappropriate for the participants' needs. For about 
one-third of the searches for the GSIA group the librarians felt that the search was 
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less than successful. This was true for less than one-sixth of the searches for 
the Chem/Chem E group. The major problem during the study was getting the 
sustained cooperation of the participants: in getting them to keep appointments 
in providing feedback on searches. It is hard to see how this problem could be 
overcome, given the many demands on the time of faculty members. All librarians 
involved felt that the study had improved the relationships between them and 
faculty, the faculty being made more aware of the capability of the library 
services and the librarians being made more aware of the needs and special 
interests of the faculty members. 

The study raised some questions for future consideration. Is there a 
predictable fluctuation in literature searching needsT ..Is there a different pattern 
for teaching faculty from that of those engaged solely in research? It mxght 
be valuable to compare faculty with people in similar fields in business and 
industry. What level of information is required? When is a title or abstract 
sufficient? HOW can faculty access to the resources of neighboring libraries be 
facilitated? 



CONCLUSIONS 



A major problem for the SUPA/GSIA gro„p as opposed to the other group was that 
in .any oases the topics of their research^were interdisciplinary and no srngle ^ 
database contained references from all the relevant sources. The easy access to .n- 
house journals did not appear to maKe citations to those journals more desrrable 
than citations to journals available elsewhere, nor was timeliness a sign.frcant 

.here were some differences between the two groups in their library use and 
in the methods they used to .eep up-to-date. The Chem/Chem B's reported more fre.ue„ 
library browsing. The SUPVCSI. group depended very heavily on personal co-unrcat.or 

TO meet their current awareness needs, however, it appeared that the tables of 
contents provided a more valuable service than the computer updates, especially for 
the S.PVCSIA group. This would seem to indicate that there is strll a place for 
such manually operated services, despite the current trend towards computer based 

4.v,=4- 4-v,o ;,vai 1 ahilitv of tables of contents ot a 
V. A r.-rr.c^ T +- flopc^ sDDear that the avai±aoJ. J..i.>-y ^-^ 
updating mechanisms, it aoes appeai. 

r • ie a valuable service and a viable economic 

carefully selected group of journals is a valuable ser 

alternative to computer updates. 
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Table 4 



Cost of Updates Chem/Chem E SUPA/GSIA 

$ 0 - 20 38% 36% 

21 - 40 46% 18% 

41 - 60 0% 27% 

61 - 80 15% 9% 

81 -100 0% 9% 



TABLE 4 Distribution of the total cost of supplying the 

updates for the six month period for the two groups.. 
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ADDENDUM 

QUESTIONNAIRES USED DURING THE STUDY 
Questionnaires lA and IB 

(Used with participants and non-participants after the in tial random sampling) . 

Purpose : to determine previous experience with computer-based searching and 
current awareness services, and to determine response bias. 

Questionnaire 2 

(Used with all participants at the beginning of the study) . 
Purpose ; to develop search strategy for the retrospective search. 

Questionnaire 3 

(Used v:ith participants selected to receive tables of contents) . 

Purpose ; to detearmine which tables of contents the participants wished to receive. 
Questionnaire 4 

(Used with all participants after the retrospective search) . 

Purpose : to elicit participant evaluation of the retrospective search. 

Questionnaire 5 

(Used by participants on a continuing basis after citations were looked up) . 

Purpose : to obtain information on participants* attempts to obtain cited references. 

Questionnaire 6 ; 

(Administered to all participants at the close of the study by means of interview) . 

Purpose ; to evaluate retrospective searches and the two types ol current awareness 

services (computer updates and tables of contents) and to determine methods 
used by participants to keep up-to-date in their fields (for the groups 
receiving only one type of current awareness service questions which did 
not apply were omitted.) 

Questionnaire 7 : 

(Completed by the librarians as the study progressed) . 

Purpose; to gain information on retrospective searches and updates, regarding number 
of databases used, search terms and cost. 




ADDENDUM (Continued) 



Questionnaire 8 ; 

,M.inisterea to the librarians after the end of the study) . 

, fh, nro-iect and to gain information which would enable 
PurP°2El t° t^i^provi our serroh services and current awareness services. 
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Non-Participants 



Name 



Number 



Initials of 
Recorder 



1 . For which of the following reason? are you not able to participate? 

Not on campus (summer) 
Too busy 

Just not interested 
Other (specify) 



1 

2 

3 
4 



2. Have you ever received computerized bibliographic 
searches either at C-MU or elsewhere? 

If yes, was it a current awareness service? 



Yes 
No 
Yes 
No 



1 

2 
1 

2 



3 Have you used any of the following types of current 
* awareness services either at C-MU or elsewhere: 

Manual SDI (selective dissemination of information). 
Use of the journal "Current Contents" published 
by ISI. 

Tables of contents distribution. 
Other current awareness services. 
None. 

4. HOW regularly do you visit C-MU libraries to span journals? 
(i.e. to browse and keep up with current information.; 

More than once a week. 

Less than weekly but more than once a month. 

Less than once a month. 

Rarely. 



Yes 
No 

Yes 
No 

Yes 

No 

Yes 

No 

Yes 



1 

2 

1 

2 

1 

2 

1 

2 

1 



1 

2 



Use this space to 



record other comments volunteered by non-participants, 
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Quest iovrr.airc IF 

PARTICIPANTS 

Initials of 

Name Number Recorder^ 



Yes 1 



1 • Have you ever received computerized bibliographic 

searches either at C-MU or elsewhere? No 1 2 



If yes, was it a current awareness service? 




2* Have you used any of the following types of current 
awareness services either at C-MU or elsewhere: 



Manual SDI (selective dissemination of information). No 

Yes I 

Use of the journal "Current Contents" published ivyo 1 2 

by ISI. ' 1 

Tables of contents distribution. jjo 



Yes I |1 



other current awareness services. No^ l^H ^ 

None. 



□ 



3. How regularly do you visit C-MU libraries to scan 
journals? (i.e. to browse and keep up with current 
information.) 

More than once a week. 

Less than weekly but more than once a month. | | 2 

Less than once a month. j | 3 

Rarely^ | | 4 



Use this space to record other comments volunteered by participants. 
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CAru^r-GlE-Kii-LLOi^ 'Ui\lVhKfclTY LxjibLnRlhS CURRENT A\vARENESS blUDY 2; 

COMPUTER SEARCH QUESTIOI^INAIRE 
(5-year retrospective search) 

PARTICIPANT'S NAME. DEPT. REF.NO. 

SUBJECT SPECIALIT Y ^Tel. No. 

ENTER A NARRATIVE DESCRIPTION OF THE PROBLEM TO BE SEARCHED. BE SPECIFIC: 
DEFINE PHRASES WITH SPECIAL MEANING. 



List up to ten (or more) significant words, phrases, key words or word stems. 
Include alternate spellings. 



IS YOUR^-TOPIC THEORETICAL OR APPLIED? IF APPLIED INDICATE APPLICATIONS OR 
END USES. ^ 



HOW MANY ARTICLES DO YOU EXPECT TO FIND IN THE PAST 5 YEARS? 
50 or more_ 20-50 10-20 less than 10 



^IVE A TITLE TO YOUR SEARCH 



LIST THE JOURNALS IN WHICH YOU NOW EXPECT TO FIND PERTINENT ARTICLES. 



LIST TWO OR THREE OF THE MOST IMPORTANT AUTHORS ( AND/OR ORGANIZATIONS) 
PUBLISHING ON YOUR TOPIC (COMPLETE NAMES, IF KNOWN, ARE HELPFUL). 



IF AVAILABLE LIST THE COMPLETE CITATIONS TO TWO OR THREE OF THE MOST USE- 
FUL ARTICLES ON YOUR SEARCH TOPIC. (IT MAY BE HELPFUL TO BRING THESE 
ARTICLES TO YOUR APPOINTMENT). 



I 
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Questionnaire ,3. 

CARNEGIE-MELLON UNIVERSITY LIBRARIES CURRENT AV/AREIvTSS STUDY 

TABLES OF CONTENTS 

PARTICIPANT'S NAM E DEPT. REF.NO. 

SUBJECT SPECIALITY Tel. No. 



Please list six Journal titles received by C-MU Libraries, Hunt, E&S and MI 
for which you wish to receive the table of contents. Do not list journals 
you receive personally, or those you regularly scan in the library or elsewherf 

1. 

2. : 

3. 

4. ___^ 

5. _____^ 

6. 
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Questionnaire 



u Jr^.i^/:-. J. h)\ finals z.:2^o rr. Ju' i 



To be completed by participant after the retrospective search has 
been received and reviewed. 

1 • Please check any aspects of the retrospective search which 
you find unsatisfactory: 

i. I received too many references and would like the search 
narrowed. 

ii. I received too few references and would like to broaden 
the search. 

iii.. Too many of the references are irrelevant and do not 
describe the topic requested. 

iv. Important references have not been picked up. 

V. I received too many foreign language references. 

vi. Many of the references were not available in the 
library. 



vii. Other 



p 
□ 

□ 

□ 
□ 

□ 



2. Please check any aspects of the search you found helpful in your 
research. 

i. Prevented duplication of research conducted elsewhere. 

ii. I was made aware of other researchers in the same j 
field. 

iii. I found relevant references I would not otherwise |^ — | 
have known of. 
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iv. I was provided with new research leads. 
V. Other 



Approximately how many relevant citations per month do you 
expect to find in the updates/table of contents to be 
provided later. (Please complete box(es) which apply to 

^ Tables of contents 

Computer updates 

The cost of your retrospective search was $ . 

In retrospect would you have been willing to pay for it? 

Yes, from my funds 

Yes, from my research grant 

Yes, from department funds 
No. 

What is the most you would have been willing to pay from your 
own funds had the search not been free? $ 



32 



Questionnaire 



" CARNEGIE-MELLON UNIVERSITY LIBRARIES CURRENT AWARENESS STUDY 

Please complete this form for every article referenced, which 
ycu decided you would like to read, even if you were unable 
to obtain it. 

Author 

Article title 

1 . How did you make the decision to read this article? 

Title sounded pertinent. 

Author known to be in your field. 

Institution of author known. 

Other (specify) 



Ref.no. 



1 

2 
3 
4 



2. Where was this article referenced? (You may check more 

than one) 

Original computer search. 
Computer-generated update. 
Contents pages. 

3. Were you able to obtain a copy of this article? 

If 'yes' please answer the following questions: 

4. How did you get hold of this article? 



From the shelves of a C-MU Library. 

In person from another Pittsburgh 
Library. 

Via the photocopy/ Interlibrary Loan 
Service of C-MU Libraries. 

Other (specify) 



1 
2 
3 



Yes 
No 



1 

2 

3 
4 



5. How long did it take to obtain this article after you 
began looking for it? 

Same day. 
Within one week. 
1-2 weeks. 

More than 2 weeks but less than 
a month. 

Over one month. 



1 

2 

3 
4 
5 



6. How useful was it? 
EMC Name 



Of no 
use 



Date 



_Dept., 



Very 
Useful 



r V: s J c nr: a ire (• 



Final Questionnaire 



1. To what use did you put the retrospective search (or to what future use 
do you intend to put it) ? 



2. Do you use any of the following methods to keep abreast of the literature 
in your field? 

1. "Current Contents" 

2. Indexes and abstracts 

3. Personal communication 

4. The work of a research assistant 

5. Conferences 

6. Personal subscription to journals 

7. Browsing in periodical collection 

8. Other (please specify) 
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3. Do you feel the need for library-provided services to keep up-to-date with 
the information in your field? 



Yes 
No 



If 'yes' what would you like to see the library provide for you? 

Computer Updates 

Tables of Contents 

Daily list of periodicals received 

Other (specify) 



4. To what use did you put the tables of contents and computer updates that were 
provided for you? 

a. table of contents 



b. computer updates 
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Did you find any of the following unsarisf actory aspects of the 
computer updates that were provided for you? 



1. Many of the references were irrelevant 

2 . Important 

3. Many of the references were not available in 
the C-MU libraries 

4. There is too great a time lag between articles 
being published and appearing in the updates 

5. Other, please specify 



Has the number of references which you found relevant in (a) the tables 
of contents and (b) computer updates: 

been more than you expected 

less than you expected 

about what you expected 



If you had the option would you wish to continue receiving these services 
a) computer updates - if they were free Yes 



No 



if you had to pay Yes_ 

No 

b) table of contents - if they were free Yes_ 

No _ 

if you had to pay Yes_ 

No 



Did the computer updates bring to your attention articles 

of which you would not otherwise have been aware? Yes_ 

No 



Did the contents pages bring to your attention articles 

of which you would not otherwise have been aware? Yes_ 



No 
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8* (Continued) 



Questionnaire 6, Page 3 of 3 pages 



Was it important to you that the information contained in the 

contents pages was available to you as soon as it was 

published? Yes 

No_ 

9. How often would you like to receive computer updates: 

Once a month 

Once every two months 

Other (specify) 



10* Please rate the usefulness to you of both these services as: 

Computer updates Tables of contents 
Valuable Valuable 



Useful . Useful 

Adequate Adequate 

Useless Useless 

11. Did you tell other colleagues about these services? 

Yes 

No 



12. Have you requested additional computer searches since the project began? 

Yes 

No 



13. Do you have any comments on the survey or on the current awareness services? 
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Questionnaire 



FORI-: TO BE COMPLETED BY LIBRARIAN ON EACH PARTICIPANT 
(Ccriplete first part in September, and update as necessary) 

No. of participant 

RETROSPECTIVE SEARCH 

1. Total time spent on retrospective search: (i) development 

(ii) on-line 



?. Total cost of retrospective search: 

Total number of references in retro- 
spective search: 



Names of databases finally used in search: 

(I) (II). 

(Ill) . 



5. Any other bases used and rejected: (I) 

UPDATES FOR PARTICIPANTS RECEIVING UPDATES 

e. DATA BASE USED FOR UPDATE 

7. Type of update: automatic 

8. Number of terms used in updates:! 



(II) 



save search 



re-enter 









# of references 


Cost t 


Computer update 


1 


September 








2 


October 






M n 


3 


November 






V II 


k 


December 






n It 


5 


January 






It It 


6 


February 







COMPLETE FOR ALL PARTICIPANTS 

9. Ho you feel that the search was successful? 

Not at all 

10. Do you feel that the data base(s) were 
appropriate? 

Not at all 



I 



Very 

successfui 



Very 

successfi. 



Suggestions and comments (e.g. request new data bases from vendor, 
O was Darticipant unhelpful ) (Use space overleaf if required). 

ERIC . . ^ 
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Questionnaire 



Librarian Questions 
How many of the participants were present at their searches? 

1A. Did you find it helpful to have the participants present' 



Identify problems you encountered during the searches. 



Have you had more requests for searches from: 

a. participants 

b. people in same department as professor 



Can you suggest anything which would have improved the project? 



In retrospect would you want to structure the searches differently; 
Use different databases? 



Do you have any opinions on what current awareness services would 
meet the needs of your participants? 
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